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Abstract 

In this paper, we prove a comparison result between semicontinuous viscosity sub and supersolu- 
tions growing at most quadratically of second-order degenerate parabolic Hamilton- Jacobi-Bellman 
and Isaacs equations. As an application, we characterize the value function of a finite horizon stochas- 
tic control problem with unbounded controls as the unique viscosity solution of the corresponding 
dynamic programming equation. 



1 Introduction 

In this paper, we are interested in the second-order equation 
d 

+ Hlx, t, Dw, D 2 w) + GO, t, Dw, D 2 w) = in R N x (0, T), 

(1) 

w(x,0)=ip(x) in M N , 

where N > 1, T > 0, the unknown w is a real- valued function defined in M N x [0,T], Dw and D 2 w 
denote respectively its gradient and Hessian matrix and ip is a given initial condition. The Hamiltonians 
H, G : M N x [0, T] x M N x Sn(H) — > M are continuous in all their variables and have the form 

H(x,t,p,X) = inf Ub(x,t,a),p) +£{x,t,a) - Tr [a{x,t, a)a T {x,t, a)X]\ (2) 

and 

G(x,t,p,X) - sup {-(g(x,t,P),p) - f(x,t,0) - Tr [c(x, t, p)c T {x, t, p)X] } . (3) 

This kind of equation is of particular interest for applications since it relies on differential game theory 
(Isaacs equations) or on deterministic and stochastic control problems when either H = or G = 
(Hamilton- Jacobi-Bellman equations) . 

Notations and precise assumptions are given in Section [5] but we point out that we allow one of the 
control set A or B to be unbounded and the solutions to ^ may have quadratic growth. Our model case 
is the well-known stochastic linear quadratic problem. We refer to Bcnsoussan [10], Fleming and Rishcl 
[18] , Fleming and Soner [19^ , Oksendal [38] , Yong and Zhou [41] and the references therein for an overview 
and to Examples 12.21 and 13.11 below. This problem can be described as follows. Let (ft, T , {Ft)t>o,P) be 
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a filtered probability space and let {Wtjt be a J-j-adapted standard M-Brownian motion. The control set 
is A = Ft k for some k > and we consider the linear stochastic differential equation 

f dX s = [A(s)X s +B(s)a s ]ds + [C(s)X s +D(s)]dW s , for t < s < T 
\X t = x 

where a s G At, the set of A- valued J^-progressively measurable controls and the adapted process X s is 
the solution. The linear quadratic problem consists in minimizing the quadratic cost 

V(x,t)= inf E{/ [(X s ,Q(s)X s ) + R\a s \ 2 }ds + (X T ,SX T )}, (4) 

where A(-), B(-),C(-), D(-),Q(-) and S are deterministic matrix-valued functions of suitable size and 
R > to simplify the presentation. The Hamilton- Jacobi equation associated to this problem is 

- {A{t)x,Dw) ~ (x,Q(t)x) + — \B(t) T Dw\ 2 - Tr [a(x, t)D 2 w] = ^ 
w(x, T) — (x, Sx), 

where a(x,t) = [C(t)x + D(t))(C(t)x + D{t)) T /2. Note that this equation is of type (D (with G = 0) 
since 

J-|£?(*f£> W | 2 = sup { - (B(t)a,Dw) ~ R\a\ 2 \. (6) 

In this paper, we are concerned with two issues about this problem. 

The first question relies on the partial differential equation (JSJ) - We note that the quadratic cost 
with unbounded controls leads to a quadratic term with respect to the gradient variable. From the 
terminal condition, we expect the solutions have quadratic growth. Moreover, the diffusion matrix may 
be degenerate. Therefore, we cannot hope to obtain smooth solutions in general. We need to consider 
weak solutions, namely viscosity solutions. (We refer the reader who is not familiar with this notion 
of solutions to Crandall, Ishii and Lions [15], Fleming and Soner Q]5], Bardi and Capuzzo Dolcetta [3J 
and Barles [6] and all the references therein). We obtain the existence of a unique continuous viscosity 
solution for ([5]) and for a large class of equations of type (Q} (see Theorem 12.11 and Corollary 12. 1[) . 

We point out that the results obtained in this paper are beyond the classical comparison results for 
viscosity solutions (see e.g. [15]) because of the growth both of the solutions and the Hamiltonians. In fact, 
most of the comparison results in the literature require that either the solutions are uniformly continuous 
or the Hamiltonian is uniformly continuous with respect to the gradient uniformly in the x variable (in 
our case this amounts to assume that both controls sets are compact). Let us mention that uniqueness 
and existence problems for a class of first-order Hamiltonians corresponding to unbounded control sets 
and under assumptions including deterministic linear quadratic problems have been addressed by several 
authors, see, e.g. the book of Bensoussan [10] . the papers of Alvarez ;2i, Bardi and Da Lio [4], Cannarsa 
and Da Prato [T^], Rampazzo and Sartori [JU] in the case of convex operators, and the papers of Da Lio 
and McEneaney [16] and Ishii [22] for more general operators. As for second-order Hamiltonians under 
quadratic growth assumptions, Ito [23] obtained the existence of locally Lipschitz solutions to particular 
equations of the form ([T]) under more regularity conditions on the data, by establishing a priori estimates 
on the solutions. Whereas Crandall and Lions in [14] proved a uniqueness result for very particular 
operators depending only on the Hessian matrix of the solution. Kobylanski [26] studied equations with 
the same kind of quadratic nonlinearity in the gradient than ours, but her existence and uniqueness results 
hold in the class of bounded viscosity solutions. Finally, one can find existence and uniqueness results 
for viscosity solutions which may have a quadratic growth in [7] for quasilinear degenerate parabolic 
equations. 

The second question we deal with in this paper concerns the link between the control problem (U) 
and Equation ([5]). The rigorous connection between the Hamilton- Jacobi-Bellman and optimal control is 
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usually performed by means of a principle of optimality. For deterministic control problems which lead 
to a first-order Hamilton- Jacobi equation, see Bardi and Capuzzo Dolcetta [3] and Barles [BJ; for the 
connections between stochastic control problems and second-order Hamilton- Jacobi-Bcllmann equations 
we refer to Fleming and Rishel jH] , Krylov [27] , Lions (31] |32l [33] , Fleming and Soner [19] , Yong and 
Zhou [HJ Theorem 3.3] and the references therein. 

However, for stochastic differential equations with unbounded controls as in stochastic linear quadratic 
problems, additional difficulties arise. Some results in this direction were obtained for infinite horizon 
problems, in the deterministic case by Barles 5 and in the stochastic case by Alvarez 1 . In this paper, 
we characterize the value function ((4]) as the unique solution of ([5]). Actually, our results apply for a 
larger class of unbounded stochastic control problems 

V{x,t)= inf E{/ £(X s ,s,a s )ds + ^(X T )} (7) 

a s eAt J t 

where the process X s is governed by 

dX s = b{X sl s,a s )ds + cr(X sl s,a s )dW s , , 

X t = x, <■*> 

where A is a possibly unbounded subset of a normed linear space and all the datas are continuous with 
the following restricted growths: b grows at most linearly with respect to both the control and the state, 
a grows at most linearly with respect to the state and is bounded in the control variable, ip can have a 
quadratic growth and £ grows at most quadratically with respect to both the control and the state with 
a coercitivity assumption 

£(x,a,t)> V -\ a \ 2 ~C{l + \x\ 2 ). (9) 

In this case, the Hamilton- Jacobi equation looks like (JTJ with G = (see Section [3] for details). Because 
of the unbounded framework, the use of an optimality principle to establish the connection between the 
control problem and the equation is more delicate than usual. Thus we follow another strategy which 
consists in comparing directly the value function with the unique solution of the Hamilton- Jacobi equation 
as long as this latter exists (see Theorem 13. 

It is worth noticing that, surprisingly, for the general stochastic linear problem, it is not even clear 
how to give sense to the partial differential equation associated to the stochastic control problem! For 
instance, consider again the above linear quadratic problem where (t{x, t, a) — C(t)x + D(t) is replaced by 
C(t)x + D(t)a which depends now both on the state and the control. Taking A, C, Q = and B,R,D = 1 
to simplify, the Hamiltonian in ([5]) becomes 



sup 

ueR k 



{-{a,Dw)-\a\ 2 -^Aw} (10) 



which is +oo as soon as Aw < — 2. The connection between the control problem and the equation in this 
case was already investigated (see Yong and Zhou [41] and the references therein). The results need a 
priori knowledges about the value function (the value function and its derivatives are supposed to remain 
in the domain of the Hamiltonian). We do not consider the case when a is unbounded in the control 
variable in this paper. It is the aim of a future work. When finishing this paper, we learnt that Krylov 
[2"8] succeeded in treating the general stochastic linear regulator. But his assumptions are designed to 
solve this latter problem (the datas are supposed to be polynomials of degree 1 or degree 2 in (x, a)) and 
the proofs rely heavily on the particular form of the datas. 

Another important example of equations of type ([1]) where concave and convex Hamiltonians appear 
is the first-order equation 



dw . f 7 



mm 



, 2 



dt aem k 12 ' j pes 



a\ 2 - (a(x)a,Dw) \ + m&x{-(g(x, /3), Dw) - f{x,/3)} = (11) 
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in M N x (0, T). Such kind of equation is related to the so-called iJoo-Robust control problem. This problem 
can be seen as a deterministic differential game. We refer the reader to Example 13.31 and McEneaney 
[341 [35l [36] , Nagai [37] and the references therein for details. 

Finally, we point out that one of the main fields of application of these types of equations and problems 
is mathematical finance, see e.g. Lamberton and Lapeyre [29], Fleming and Soner [19], 0ksendal [38] and 
the references therein for an introduction. For recent papers which deal with equations we are interested 
in, we refer to Pham [31] and Benth and Karlsen [TT] (see Example 13. 2[) . 

Let us now describe how the paper is organized. 

Section [2] is devoted to the study of (fT]). More precisely, we prove a uniqueness result for (TTJ) in the set 
of continuous functions growing at most quadratically in the state variable under the assumption that 
either A or B is an unbounded control set, the functions b, g and £, f grow respectively at most linearly 
and quadratically with respect to both the control and the state. Instead the functions a, c are assumed 
to grow at most linearly with respect to the state and bounded in the control variable. 

One of the main tools within the theory of viscosity solutions to obtain a uniqueness result is to 
show a comparison result between viscosity upper semicontinuous subsolutions and lower semicontinuous 
supersolutions to (fT]), see Theorem 12.11 Indeed, the existence and the uniqueness f Corollary 12. ip follow 
as a by-product of the comparison result and Perron's method of Ishii [21j . However, under our general 
assumptions one cannot expect the existence of a solution for all times as Example l2.2l shows . 

The method we use in proving the comparison Theorem l2.1l is similar in the spirit to the one applied by 
Ishii in |22] in the case of first order Hamilton- Jacobi equations and it is based on a kind of linearization 
procedure of the equation. Roughly speaking, it consists in three main steps: 1) one computes the 
equations satisfied by ^ = U — [iV (U, V being respectively the sub and supersolution of the original 
pde and < \i < 1 a parameter); 2) for all R > one constructs a strict supersolution of the linearized 
equation such that Xr( x i t) &s R oo; 3) one shows that ^(x, t) < Xr( x i t) an d then one concludes 
by letting first R — > oo and then fi — > 1. 

In Section [3] we give applications to finite horizon stochastic control problems previously mentioned 
and we provide some examples. 

In Section U] we deal with particular cases where both controls are unbounded but H (or G) is 
"predominant" in H + G (see Remark 12.21 and Theorem 14. 1[) . For instance, we are able to deal with 
equations of the form 

^_M^ + l^MgH! = in ^ x(0 ,T) 

where Si, S2 are Nxk matrices, which corresponds to the case a, (3 G M k , a = c = 0, b(x, t, a) — Si(x)a, 
g(x,t,p) = E 2 (x)P and £(x,t,a) = \a\ 2 /2, f(x,t,fi) = |/3| 2 /2 in © and ©. The comparison result 
applies if either (S x Sf)(a;) > (S 2 S^)(x) or (S x Ef)(a;) < (E 2 T$)(x). 

When neither H nor G) is "predominant" , the problem seems to be very difficult and our only result 
takes place in dimension N — 1: we have comparison for 

^ + h(x,t)\Dw\ 2 = mM N x (0,T), (12) 

where the function h may change sign (see (A5) for details). Finally, we point out that assumptions and 
proofs in Section [4] essentially differ from those of Theorem 12.11 (see Remark l4.ip . 

Acknowledgments. We are grateful to Martino Bardi and Guy Barles for valuable suggestions 
during the preparation of this work. The first author is partially supported by M.I.U.R. project "Viscosity, 
metric, and control theoretic methods for nonlinear partial differential equations." The second author is 
partially supported by the ACI project "Mouvement d'interfaces avec termes non locaux" . 
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2 Comparison result for the Hamilton-Jacobi equation (CD) 

In order to give precise assumptions upon Equation (JTJ) and ([2]), ([3]), we need to introduce some notations. 
For all integers N, M > 1 we denote by M.n,m(1R) (respectively Sn(R), S^(M)) the set of real N x M 
matrices (respectively real symmetric matrices, real symmetric nonnegative N x N matrices). All the 
norms which appear in the sequel are denoting by | • |. The standard Euclidean inner product in R N is 
written (•, •). We recall that a modulus of continuity m : IR — ¥ 1R + is a nondecreasing continuous function 
such that m(0) = 0. Finally B(x, r) = {y G R N : \x — y\ < r} is the open ball of center x and radius 
r > 0. 

We list the basic assumptions on H, G and We assume that there exist positive constants C and 
v such that: 

(Al) (Assumptions on H given by : 

(i) A is a subset of a separable complete normed space. The main point here is the possible unbound- 
edness of A. Therefore, to enlight this property in the sequel, we take A = R k for some k > 1 (see 
Remark 12.11 above) ; 

(ii) b G C(M N x [0, T] x R k ; R N ) satisfying for x,y £ R N , t € [0,T], a € R k , 

\b(x,t,a)-b(y,t,a)\ < (7(1 + \a\)\x - y\ 
\b(x,t,a)\ < C(l + \x\ + \a\) ; 

(hi) I G C{R N x [0, T] x R k - R) satisfying for x G R N , t G [0, T], a G M k , 

(7(1 + |.t| 2 + H 2 ) > £(x,t,a) > ^\a\ 2 +£ (x,t,a) with 4(x,t,a) > -0(1 + \x\ 2 ), 

and for every R > 0, there exists a modulus of continuity ma such that for all x,y G B(0,R),t G 
[0,T],«e JR fe , 

K(ar,t,a)-£(y,i,a)| < (1 + |a| 2 ) m fl (|x - y|) ; (13) 

(iv) cr G C(R N x [0,T] x R k ;AiN,M{R)) is locally Lipschitz continuous with respect to a; uniformly 
for (i,a) G [0,T] x JR fe and satisfies for every x G JR^, i G [0,T], a G J? fc , 

|<7(a; ) t,a)|<C(H-|a:|). 

(A2) (Assumptions on G given byQ) : 

(i) B is a bounded subset of a normed space; 

(ii) g G C(R N x [0,T] x B;R N ) is locally Lipschitz continuous with respect to x uniformly for 
(t,P) G [0,T] x B and satisfies for every x G l", f G [0,T], f3 £ B, 

\g(x,t,p)\<C(l + \x\) ; 

(iii) / G C(R N x [0, T] x B; J?) is locally uniformly continuous with respect to x uniformly in (t, j3) G 
[0, T] x B and satisfies for every x € J?^, t G [0, T], (3 £ B, 

\f(x,t,(3)\<C(l + \x\ 2 ); 

(iv) c G C(R N x [0, T] x _B; M. m ,m(^)) ^ s locally Lipschitz continuous with respect to x uniformly for 
(t, P) G [0, T]xB and satisfies for every x G t G [0, T], /3 G S, 

|c(x, t,/3) | < C(l + H). 



UNIQUENESS RESULTS FOR BELLMAN-ISAACS EQUATIONS 



6 



(A3) (Assumptions on the initial condition t/j) : 
ijj € C(M N ;M) and 

\*l>(x)\ <C(1+ \x\ 2 ) for every x € M N . 

Remark 2.1 (i) About (Al)(i): we choose to take A = M k in this section to enlight the possible 
unboundedness of A in the notation. Indeed, the calculations when A is any subset of a complete 
separable normed space are the same and are based on the following inequality: for every p > 0,7 € 1R, 

inf {pH' + 7 |«| } = iof { (VPN 2 + 2 - £ I > _£ (14) 

(ii) Note that, with respect to the gradient variable, i? is a concave function and G is a convex 
function. Under Assumptions (Al) and (A2), classical computations show that H and G are continuous 
in all their variables. 

Example 2.1 The typical case we have in mind is when H is quadratic in the gradient variable, for 
instance A = M k , £(x,t,a) — \a\ 2 /2, a = and b(x,t,a) = a(x)a where a e C '(M N '; M n ,*(•#£)) is locally 
Lipschitz continuous and bounded for all x G M N . It leads to 

H(x,p) = inf {(a(x)a,p) + ^!} = (15) 

This particular example is treated both in Ishii [22] and in Da Lio and McEneaney [16] in the case of first 
order Hamilton- Jacobi-Bellman equations under more restrictive assumptions than ours. In particular, a 
has to be a nonsingular matrix in [22]. See also Section [4] for some further comments. 

For any O C M K , we denote by USC(0) the set of upper semicontinuous functions in O and by 
LSC(0) the set of lower semicontinuous functions in O. 
The main result of this section is the 

Theorem 2.1 Assume (A1)-(A3). Let U € USC(M N x [0,T]) be a viscosity subsolution of (QP and 
V € LSC(M N x |0,T]) &e a viscosity supersolution of (Q]). Suppose that U and V have quadratic growth, 
i.e. there exists C > such that, for all x € IR , i £ [0, T], 

|[/0M)|, <C(l + |x| 2 ). (16) 

T/ien U <V in M N X [0,T]. 

The question of the existence of a continuous solution to ([T]) is not completely obvious. In the 
framework of viscosity solutions, existence is usually obtained as a consequence of the comparison principle 
by means of Perron's method as soon as we can build a sub- and a super-solution to the problem. Here, 
the comparison principle is proved in the class of functions satisfying the quadratic growth condition (|16[) . 
Therefore, to perform the above program of existence, we need to be able to build quadratic sub- and 
super-solutions to (JlJ. In general one can expect to build such sub- and super-solutions only for short 
time (see the following lemma and Corollary I2.1j) . In Example I2.2[ we see that solutions may not exist 
for all time. 



Lemma 2.1 Assume (Al)-(A3). IfK>C+l and p are large enough, thenu(x,t) = — Ke pt (l + \x\ 2 ) 

<[0 

is a viscosity supersolution of (Qp in M N x [0,r] 



is a viscosity subsolution of (QP in M N x [0, T] and there exists < r < T such that u(x, t) = ife pt (l-|-|a;| 2 ) 
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Proof of Lemma Un\ We only verify that It is a supersolution (the proof that u is a subsolution being 
similar and simpler). Since K > C + 1, we have u(x,0) = K(l + \x\ 2 ) > ip(x). Moreover, since u is 
smooth and using (Al), (A2) and (fT4)) . we have 

— + H(x, t, Du, D 2 u) + G(x, t, Du, D 2 u) 
= Kpe pt {l + \x\ 2 ) + H{x, t, 2Ke pt x, 2Ke pt Id) + G(x, t, 2Ke pt x, 2Ke pt Id) 

> Kpe pt (l + \x\ 2 ) + inf {-(7(1 + \x\ + \a\)}2Ke pt \x\ + ^-\a\ 2 - (7(1 + |a;| 2 ) - C 2 {1 + \x\) 2 2Ke pt } 

ai Hi- I 

+ sup{-(7(l + \x\)2Ke pt \x\ - (7(1 + \x\ 2 ) - C 2 (l + \x\) 2 2Ke pt } 

> iYpc pt (l + |a;| 2 )-A'(10(7+12(7 2 )e p '(l + |a;| 2 )+ inf {-2KCe pt \x\\a\ + ^-\a\ 2 } 

a£R k 2 



> 



9C! 2 Kp pt 

IOC — 12C 2 — 



Ke pt (l + \x\ 2 ). 



We notice that iitp < 1 and p > is large enough, then the quantity between the brackets is nonnegative. 
Hence the result follows with < r = 1/ p. □ 

As explained above, Theorem 12.11 together with Perron's method implies the following result. We 
omit its proof since it is standard. 

Corollary 2.1 Assume (A1)-(A3). Then there is t > such that there exists a unique continuous 
viscosity solution of £2]] in M N x [0,r] satisfying the growth condition &16)) . 

Remark 2.2 (i) For global existence results under further regularity assumptions on the data we refer 
the reader to Ito [23]. For a case where blowup in finite time occurs, see Example 12.21 which follows. 

(ii) Theorem 12.11 and Corollary 12.11 hold when replacing "inf" by "sup" and by "— £" in H or/and 
"sup" by "inf" and "/" by "— /" in G. To adapt the proofs, one can use the change of function w' := —w 
or to consider pU — V instead of U — pV in the proof of Theorem 12.11 Therefore it is possible to deal 
either with unbounded controls in the "sup" in order to have a convex quadratic Hamiltonian or to deal 
with unbounded control in the "inf" in order to have a concave quadratic Hamiltonian. 

(iii) Up to replace t by T — t, all our results hold for 

— -7T- + H(x, t, Dw, D 2 w) + G(x, t, Dw, D 2 w) = in 1R N x (0, T), 
w(x, T) = ip(x) in M N 

This latter equation with terminal condition is the one which arises usually in control theory, see Example 
Oand Section [3J 

(iv) In this section, we are not able to consider the case when both a in H and (3 in G are unbounded 
controls. Roughly speaking, one of the reason is that unbounded controls lead to quadratic Hamiltonians. 
When both controls are unbounded, we then obtain two quadratic-type Hamiltonians, a concave and a 
convex one. Let us explain the difficulty on a model case where 

H{x,p) = inf {(ai(x)a,p) + — } = , G(x,p) = sup {(a 2 (x)(3,p) — } = , 

aelR k 2 2 /36JR fc 2 2 

with ai,a2 G C(M N ; AiN.k(^R)) are locally Lipschitz continuous and bounded. The difficulty to treat 
such a case is related to our strategy of proof which relies on a kind of "linearization procedure" (see 
Lemma 12.21 and its proof). In this simple case, this "linearization" uses in a crucial way the convex 
inequality 

l»l 2 Id-oI 2 

— - M 2 > -~ — — for all p,q£ M N and < u < 1, 
p 1- p 
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which does not work at the same time for a concave and a convex Hamiltonian. Of course, in this simple 
case, there are alternative ways to solve the problem: we have 

H(x,p) + G(x,p) = ^((a 1 +a 2 )(a 2 -a 1 ) T p,p), (18) 

which allows to apply Theorem l2.1l up to add some assumptions on a\ or a 2 (for instance (ai+a2)(a2 — ai) T 
is a nonnegative symmetric matrix with a locally Lipschitz squareroot). In Sectional we provide another 
approach to solve such equations (see Theorem 14.11 and Remark |4. 1 1) . 

Example 2.2 A deterministic linear quadratic control problem. 

Linear quadratic control problems (see also Section [3] for stochastic linear quadratic control problems) 
are the typical examples we have in mind since they lead to Hamilton- Jacobi equations with quadratic 
terms. On the other hand, the value function can blow up in finite time. Consider the control problem 
(in dimension 1 for sake of simplicity) 

dX s =a s ds, s e[t,T], <t <T, 
X t = x e R, 

where the control a E At ■= L 2 ([t, T}; M) and the value function is given by 

V(x,t) = inf {p [ {\a s \ 2 + \X s \ 2 )ds-\X T \ 2 } for some p > 0. 

a€At J t 

Then the value function, when it is finite, is the unique viscosity solution of the Hamilton- Jacobi equation 
of type (JTJ which reads 



-w t + ±\w x \ 2 =px 2 inKx(0,T), 
w(x, T) = —x 2 , 



(19) 



(see Theorem 13.11 for a proof of this result). Looking for a solution w under the form w(x,i) — ip(t)x 2 , 
we obtain that tp is a solution of the differential equation 

2 

- <fj + f- = p in (0, T), tp(T) = -1. (20) 
P 

We distinguish two cases: 

Case 1. — If p > 1, then the solution of (|20p is defined in the whole interval [0,T] for all T > and is 
given by 

(p-l)e^-0-(p+l) 
V{t)=P ( P - 1)^-0 ■ (21) 

which is a function decreasing from <p(0) to — 1. Therefore (|19p admits a unique viscosity solution in 
M x [0, T] which is the value function of the control problem 

V(x,t) = ip(t)x 2 . 

Note that, if p > 1 and T > ln((p + l)/(p - l))/2, then <p(Q) > 0. It follows that the value function 
satisfies (I16[) but is neither bounded from above neither bounded from below. 

Case 2.— If < p < 1 and T > ln((l + p)/(l - p))/2, then the solution of is given by (J2IJ in (f, T], 
where 

t := 1 In 



2 \l-p, 

and blows up at t = f. Therefore we have existence for ([T9"]) only in M x (f, T}. 
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Proof of Theorem \2.1\ We divide the proof of the theorem in two steps. 
Step 1. We first assume that i > 0, / < and ip < in (Al), (A2) and (A3). 
The proof is based on the two following lemmas whose proofs are postponed. 

Lemma 2.2 ( "Linearization" of Equation (J^). Let < fi < 1 and set \& = U — /iV. Suppose £ > 0, 
/ < and tjj < 0. TTien ^ is an USC viscosity subsolution of 

Flm C 2 

C[W] := •^~ 2Kl-/i) |Jw|2 ~ 2 ^ (1 + N)|Jw| (22) 
— sup Tr [cr(x, i, a)cr T (x, rj, a)£> 2 w] — sup Tr [c(x, t, (3)c T {x 1 1, (5)D 2 w\ = 

m J?^ x (0,T), with the initial condition 

w(-,0) < (1 -n)ij}< 0. (23) 

Lemma 2.3 Consider the parabolic problem 

ip t - rV rr - r^v = m [0, +oo) x (0, T] - . 

(f(r, 0) = ipn(r) in [0, +oo), 

where <pn(r) = max{0, r — R} for some R > 0. XTien has a unique solution ip £ C([0, +oo) x [0, T])f) 
C°°([0, +oo) x (0, T]) such that, for all t £ (0, T], ip(-, t) is positive, nondecreasing and convex in [0, +oo). 
Moreover, for every (r,t) £ [0, +oo) x (0, T], 

<p(r,t) > <pn(r), < <p r (r,t) < e T and ip(r,t) — ► 0. (25) 

i?^-+oo 

Let $(x,t) = ip(C(l + \x\ 2 )e Lt ,Mt)+r]t where (f is given by Lemma l2.3l L, M, rj are positive constants 
to be determined and C > max{(7, C}, where C and C are the constants appearing in the assumptions. 

Claim : We can choose the constants L and M such that $ is a strict supersolution of §22\) at least in 
M N x (0, t] for small r. 

To prove the claim, we have to show that > in M N x (0,r] for some r > 0. The function 

$ £ C(1R N x [0,T]) n C°°(1R N x (0,T]) and we have, for f > 0, 

$ t =r ? + iC(l + |x| 2 )e i Vr + M^t, L»$ = 2Cxe L Vr and L> 2 $ = 2C Ide Lt (p r + 4C 2 e 2Lt <p rr x ® x. 
Using (Al) and (A2), for all (x,t) £ M N x (0,T], we get 

£[$] > 77 + LC(l + \x\ 2 )e Lt tp r + Mip t - — -\2Cxe Lt cp r \ 2 - 2C(1 + \x\)\2Cxe Lt ip r \ 

-2(7 2 (1 + \x\) 2 \2CIde Lt tp r + 4C 2 e 2Lt x ® x ip rr \. 
Setting r = C(l + |x| 2 )e L * and since C > C, we obtain 

£[$] > 77 + Mip t - 16C 2 r 2 (p rr - 8C(C + l)rip r + [L ; ^ )ru> r . 

Our aim is to fix the parameters M and L in order to make £[$] positive. 

We first choose M > 16C 2 + 8C. Since <p is a solution of ([24]) (Lemma 12. 3p . we obtain 
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2C 3 e T+1 

Then, taking L > — -, we get £[$] > r\ > for all x G JR^ and £ € (0,r], where t = 1/L. This 

1/(1 — /i) 

proves the claim. 



We continue by considering 



max {*-$}, (27) 

: N x[M 



where ^ is the function defined in Lemma 12.21 which is a viscosity subsolution of (f2"2"j) and $ is the strict 
supersolution of (1221) in JR^ x (0,r] we built above. 

From ([21]), we have 3>(x,t) > C(l + |x| 2 ) > (7(1 + \x\ 2 ) > V(x,t) for |a:| > R. It follows that the 
maximum (|2"T|) is achieved at a point (x,f) € M N x [0, r]. We claim that i — 0. Indeed suppose by 
contradiction that t > 0. Then since ^ is a viscosity subsolution of (|2"2")l . by taking $ as a test- function, 
we would have £[$>](x,t) < which contradicts the fact that $ is a strict supersolution. 

Thus, for all (x,t) £ 1R N x [0,r], 

*(x, i) - $(x, t) < <£(£, 0) - $(£, 0) < (1 - /i)^(S), 

where the last inequality follows from (|2U)) and the fact that $ > 0. Since we assumed that ip is nonpositive, 
for every (x, t) g JR^ x [0, r], we have ^(x, t) < Q(x, t). Letting rj go to and R to +oo, we get by Lemma 
[ILS * < in R N x [0,r]. 

By a step- by-step argument, we prove that ^> < in M N x [0,T]. Therefore \P = [/ — [iV < in 
JR^ x [0,T]. Letting p go to 1, we obtain U < V as well which concludes the Step 1. 

Step 2. The general case. 

The idea is to reduce to the first case by a suitable change of function (see Ishii ). Suppose that w is 
a solution of |T]). Then, a straightforward computation shows that w(x, t) — w(x, t) — C(l + \x\ 2 )e pt , for 
C > C,C and p > 0, is a solution of 



lot + inf { (6(x, t : a), + £(x, t, a) — Tr [cr(x, t, a)a T (x, t, a)D 2 w] } 

aelP k 



+ sup {-{g{x, t, p),Dw) - f(x, t, p) - Tr [c(x, t, P)c T (x, t, P)D 2 w] } = 0, (28) 

/36-B 

[w(x,0) =i>(x)-C(l + \x\ 2 ), 
where 

i(x, t, a) = £(x, t, a) + 2Ce pt (b(x, t, a), x) - 2Ce pt Tr [a(x, t, a)a T (x, t, a)] + ~Cpe pt (1 + \x\ 2 ) , 

f(x, t, (3) = f(x, t, (3) + 2Ce pt (g(x, t, (3), x) + 2Ce pt Tr [c(x, t, (3)c T (x, t, (3)] - \c P c pt {l + \x\ 2 ). 

We observe that I and / still satisfy respectively the assumptions (Al)(iii) and (A2)(iii). Moreover from 
(A3), we can choose C > C in order that %j) < 0. 

Next we show that if p > is chosen in a suitable way then £(x,t,a) > D\a\ 2 /2 for all (x,t,a) £ 
M N x [0,1/ p] x M k and f(x,t,/3) < for all (x,t,/3) e R N x [0, 1/p] x B. Indeed for all (x,t,a) € 
M N x [0, 1/p] x JR fe by (Al) we have 

I(x,t,a) > ^\a\ 2 - C(l + \x\ 2 ) - 2CCe pt (l + \x\ + \a\)\x\ - 2CC 2 e pt (l + \x\) 2 + -Cpe^l + \x\ 2 ) 
> \\o\ 2 -(C + ACC + ACC 2 )e pt {l + \x\ 2 ) - 2CCe pt \a\\x\ + -Cpe pt {l + \x\ 2 ). 

But 

-icfi2fi2 2pt 

2CCe pt \a\\x\ < -\a\ 2 + \x\ 2 ; 



UNIQUENESS RESULTS FOR BELLMAN-ISAACS EQUATIONS 



11 



Therefore, by choosing 



p>2 g+8C + 8(7 2 + ^^, (29) 
C v 



we have 



£(x,t,a) > ^\a\ 2 for all (x,t,a) £ 1R N x [0, 1/p] x JR fc , 



which is the desired estimate with P = v/2 > and £q = 0. 

The next step consists in choosing p such that / < . Using (A2), the same kind of calculation as 
above shows that, taking 

p > 8(C + C 2 ) + 2 (30) 

ensures / < 0. 

Finally if we choose C > C and p as the maximum of the two quantities appearing in (|2"9")l and (j3T)f , we 
are in the framework of Step 1 in 1R N x [0,p]. Setting f7 = £/-C(l + |a:| 2 )e' ,t and V = V — C(l + |x| 2 )e pt , 
from Step 1 we get U < V in R N x [0, 1/p}; thus U < V in R N x [0,1/p]. Then by a step-by-step 
argument we obtain the comparison in M N x [0,T]. □ 



Remark 2.3 A key fact in the proof to build a strict supersolution of (J22J) is to use a function which is 
the solution of the auxiliary - and simpler - pde (|24p . This idea come from mathematical finance to deal 
with equations related to Blake and Scholes formula. See for instance Lamberton and Lapeyre [2 9) and 
Barles et al. jS]. 



We turn to the proof of the lemmas 12.21 and 12.31 

Proof of Lemma [Ql For < p, < 1, let V = pV and $ = U — V. We divide the proof in different 
steps. 

Step 1. A new equation for V. 
It is not difficult to see that, if V is a supersolution of ([l}, then V is a supersolution of 

DV D 2 V DV D 2 V 

V t + nH(x,t, , )+nG(x,t, , )>0 inM N x(0,T) , Q1 v 

p p p p l 6L ) 

V{x,Q) > ptp(x) in M N . 

Step 2. Viscosity inequalities for U and V. 
This step is classical in viscosity theory. Let ip G C 2 (M N x (0, T]) and (x, t) € JR^ x (0, T] be a local 
maximum of ^ — if. We can assume that this maximum is strict in the same ball B{x, r) x [i — r, i + r] 
(see [5] or [3]). Let 

|x — y\ 2 

@(x,y,t) = <p(x,t) h 5 — 

and consider 

M e := _ max {U(x,t) - V(y,t) - Q(x,y,t)}. 

x,y£B(x ,r) , te[t-r,t+r] 

This maximum is achieved at a point (x e ,y e ,t e ) and, since the maximum is strict, we know ([6], [3]) that 

lXe -» ase^O, 



and 

M £ = E^(a; e ,t e )- V-( We ,te) -0(a; e ,i/ e ,t e ) — )■ C/(x,t) - y(x,t) - v (i,t) = *(i,t) - tp(x,t). 
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It means that, at the limit e — > 0, we obtain some information on ^ — tp at (x, t) which will provide the 
new equation for fy. Before that, we can take 8 as a test- function to use the fact that U is a subsolution 
and V a supersolution. Indeed {x,t) £ B(x,r) x [i — r,i + r] i-> U{x,t) — V(y £ ,t) — Q(x,y e ,t) achieves 
its maximum at (x e ,t e ) and (y,t) £ B(x 7 r) x [t — r,t + r] H> — U(x e , t) + V(y, t) + Q(x e , y, t) achieves 
its minimum at (y e ,t £ ). Thus, by Theorem 8.3 in the User's guide |15j , for every p > 0, there exist 
ai, ct2 £ 1R and X, Y £ Sn such that 

(ai,D x &(x E ,y E ,t e ),X) £ P 2 '+{U)(x e ,t e ), (a 2 ,-D y e(x e ,y e ,t e ), Y) £ P 2 <-(V)(y e ,t e ), 

ai - a 2 = Q t (x s ,y s ,t s ) = <p t (x e ,t e ) and 

- (~ + \M\)I <( * °y) <M + pM 2 where M = D 2 Q{x £ ,y £ , t s ). (32) 



P 



Setting p £ = 2 £ » e , we have 



D x <d(x £ ,y s ,t £ ) = p £ + Dip(x e ,t s ) and D y Q(x £ ,y £ ,t £ ) = -p £ 



and 



D 2 ip(x £l t £ ) + 2I/e 2 -21 /e 2 
■ ' ~ 1 -21/ e 2 21 /e 2 



Thus, from (J32J), it follows 

(Xp,p) - (Yq,q) < (D 2 <p(x e ,t £ )p,p) + ^\p- q\ 2 + m , (33) 



where m is a modulus of continuity which is independent of p and e. In the sequel, m will always denote 
a generic modulus of continuity independent of p and e. 

Writing the subsolution viscosity inequality for U and the supersolution inequality for V by means of 
the semi-jets and subtracting the inequalities, we obtain 

Pe Y 

<pt(x e ,t e ) + H(x £ ,t £ ,Dip(x £ ,t £ ) + p £ ,X) - pH(y £7 t £ ,—,—) 

[X p 

+ G(x e ,t e ,D ( p(x e ,t e )+p e ,X)-fiG(y e ,t E ,^,-)<0. (34) 

H p 

Step 3. Estimate of Q := G(x £ , t £ , Dip(x £ ,t £ ) +p £ , X) — p G(y £ , t £ , — , — ). 

MM 

For sake of simplicity, we set 



We have 



c(x e ,t e ,P) = c x and c(y £ ,t £ , (3) = c y . 



Q = sup {-{g(x e ,t e ,P),D<p(x e ,t e ) +p £ ) - f(x e ,te,P) - Tr [c^c^X]} 

- sup {-(g(y £ ,t £ ,(3),p £ ) - pf(y £ ,t £ ,f3) - Tr [c„<£Y] } 

fieB 

> jnf {(g(Ve,te,f3) - g{x £ ,t £ ,(3),p £ ) - (g(x £ , t £ , 0), D<p(x £ , t £ )) 

-(1 - p)f(y £ ,t £ , (3) + f(y £ , t £ , p) - f(x £ , t e ,0)- Tr [c x c T x X - c v c T y Y] } 
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From (A2), if L g ^ r is the Lipschitz constant of g in B(x, r) x [t — r,t + r], then we have 

\]Js — X £ I ^ 

(g(y e ,t E ,l3) - g(x £ ,t £ ,(3),p £ ) < L g>r \y s - x e \\p e \ < 2L g>r ^ e = m(e) 

and 

-{g{x s ,t e ,l3),D<p(x s ,t s )) > -C(l + \x e \)\D<p(x e ,t e )\. 
By assumption, / < thus —(1 — /i)f(y £ ,t £ , (3) > 0. Again from (A2) it follows that 

f(Ve, te,(3)~ f(x £ , t £ ,(3)> -m(\y £ - x e \). 
Let us denote by (ei)i<i<N the canonical basis of R . By using (j3"3")l , we obtain 

N 

Tr [c x c x X - CyCyY] = ^(Xc x ei, c x ei) - {Yc v e i} c v ei) 

i=i 

2 



< Tr [c x c^D 2 (p(x s ,t e )] + — \c x - c v \ 2 + m (-^) 

< Tr[c x clDM^t e )]+2LlJ-^^l 

< Tr [c x <? x D 2 ip{x £ , t e )] + m(e) + m (4 



where L c r is a Lipschitz constant for c in B(x,r). Hence, since all the modulus are independent of e, p 
and the control, we have 

G > -C(l + \x e \)\D<p(x e ,t e )\ + inf {-Tr [c(x £ ,t e , J3)c(x e ,t s , f3) T D 2 ip(x £ , t £ )] } + m(e) + m (£) . 

S^ep i. Estimate of % '■= H(x e ,t e , Dw(x e , t £ ) + p £ , X) — u,H(y £ , t e , — , — ) . 
With the same notations as in Step 3, we have 

H > inf {(b(x £ ,t £ ,a) - b(y £ ,t £ ,a),p £ ) + (b(x £ ,t £ ,a),D<p(x £ ,t £ )) 

a£R k 

+(1 - n)£(y £ ,t £ ,a) + £(x £ ,t £ ,a) - £(y £ ,t £ ,a) - Tr [a x a x X - a y a^Y\ } . 
From (Al) the following estimates follow: 

(b(x £ ,t £ ,a) - b(y £ ,t £ ,a),p £ ) >-C(l + \a\)\x £ - y e \\p e \ > -C\ot\m(e) + m(e) ; 
(b(x e ,t e ,a),Dcp(x e ,t e )) > -C(l + \x e \)\D<p(x e ,te)\ - C\a\\D<p(x £ ,t £ )\ ; 
£(x £ ,t £ ,a) - £{y £ ,t £ ,a) > -(1 + |a| 2 )m r (|a; £ - y £ \) > -\a\ 2 m(e) +m(e). 



(1 - fi)£(y e ,t £ ,a) > (1 - /x) (^H 2 + to(x, t, a) 



^(1 — At) 2 
> z a , 



where the last inequality follows from the fact that by assumption, £q(x, t, a) > 0. 
By proceeding exactly as in Step 3 one can show that 

Tr [a x alX - o y o T y Y\ < Tr [a x a^ D 2 ip(x e , t £ )] + m(e) + m (-^) , 



UNIQUENESS RESULTS FOR BELLMAN-ISAACS EQUATIONS 



14 



where m is independent of a. Thus, using (fT4"|) . we have 

H > inf j/ Ml-M) +m{£) \ \ a f_c(\Dtp(x E ,t e )\+m(e))\a\ 



a<£R k 

+ inf {-Tr [a(x e ,t e ,a)a(x e ,t e ,a) T D 2 (p(x e ,t e )]} 

- C{1 + \x B \)\D<p(x e ,t e )\ + m(e) + m 

(C\Dcp{x £l t £ )\+m(e)) 2 - 
~ 2 V (l-n)+m(e) -g(l + I^DW^.* e )l 

+ inf {— Tr [er(x £ , i e , a)cr(a; e , t e , a) T D 2 ip(x £ , t e )] } + 771(e) + to ( -r J • (35) 
Step 5. Finally, from ([Ml) . (1551) . (|55|) . letting first p go to and then sending e to 0, we obtain 

C[p](x,f) = tp t (x,t)-—^- -\D<p(x, t)\ 2 - 2(5(1 + |x|)|D V (2,t)| 

2^(1 — (Uj 

+ inf {-Tr rcr(x,f,a)cr(x,t,a) T L»V(S,^)l} +inf{-Tr |c(s, F, /3)c(x, F, f3) T D 2 Lp(x, F)l } < 



which means exactly that ^ is a subsolution of (|22j) . □ 

Proof of Lemma \2.3l Set x(>M) = ¥>( eS ^) f° r (>M) G J? x [0,+oo). A straightforward calculation 
shows that ip satisfies ([24]) if and only if x is a solution of the heat equation 

Xt-Xss =0 in Mx(0,T) 

X (s,0) =^ fl (e s ) in ffi. lJDj 

Since the initial data satisfies the growth estimate |x(s, 0)| < e s , by classical results on the heat equation 
(John [2D, Evans Q7]), we know there exists a unique classical solution x G C(Mx [0, T]) x C°°(Mx (0, T]) 
of p6|) . It is given by the representation formula: for every (s,t) G JR x [0,T], 

X (s,t) = -^= e-^^)dy = -= e-^(ey-R)dy. (37) 
y/intJnt y/Ant Ji og R 

From the above formula, it follows x(s,i) > for all (s,t) <E M x (0, T]. Let /i > 0. We have ^fl(e s ) < 
ipfi(e s+h ) for all s G M. Since x(" + ■) is a solution of ([55)1 with initial data </jft(e s+/l ), by the maximum 
principle, we obtain x( s , t) < x( s + h,t). This proves that x is nondecreasing with respect to s. It follows 
that (p(r,t) = xQogr,t) is the unique solution of (J24j) and tp £ C([0,+oo) x [0, T])Ci C°°((0, +oo) x (0,T]) 
is positive and nondecreasing. Moreover, if the initial data is convex, we know that the solution of a 
quasilinear equation like (|24|) is convex in the space variable for every time (see e.g. Giga et al. [20]). 
Thus <p(-,t) is convex in [0, +oo) for all t G [0, T], 

It remains to prove the estimates (|23|) . Noticing that (pn(e s ) < e s and that (s,t) H> Lpu(e s ) and 
(s, i) i— > e s+ * are respectively sub- and supersolution (in the viscosity sense for example) of ([36]) . by the 
maximum principle, we obtain ipn(e s ) < x( s :0 < e s+ * < e s+T for (s,i) efix [0,T]. It follows 

PflO") < <ys(r,t) < e T r for (r, t) G [0, +oo] x [0, T\. (38) 

This gives the first estimate. To prove the second estimate, we note that </?(•, t) is a convex nondecreasing 
function satisfying (|3"5)) . It follows < cp r (r,t) < e T for (r,t) G [0,+oo] x (0,T]. The last assertion is 
obvious, using the dominated convergence theorem in (|37l) . It completes the proof of the lemma. □ 
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3 Applications 

This Section is divided in two parts. In the first part we consider a finite horizon unbounded stochastic 
control problem and we characterize the value function as the unique viscosity solution of the correspond- 
ing Dynamic Programming Equation, which is a particular case of the equation ([T]). In the second part 
we list some concrete examples of model cases to which the results of Section 1 can be applied. 



3.1 Unbounded stochastic control problems 

Let (f2, T, (Tt)t>o, P) be a filtered probability space, Wt be a J-j-adapted standard M-Brownian motion 
such that Wo = a.s. and let A be a subset of a separable normed space (possibly unbounded). We 
consider a finite horizon unbounded stochastic control problem for controlled diffusion processes X\' x 
whose dynamic is governed by a stochastic differential equation of the form 

dX^ = b(X^,s,a s )ds + a(X^,s,a s )dW s , s £ (i, T), < t < T, 
X}' x = xeR N , (M) 

where the control a s £ A, b: M N x M x A — > M N is a continuous vector field, a is a continuous real 
N x M matrix. The pay-off to be minimized is 

l-T 



J(t, x, a) = E tx {J £(Xt' x , s, a.) ds + V>(X^f)} 



where E ta . is the expectation with respect to the event X t ' x — x, the functions t : 1R N x [0,T]xi^Ji 
and i/j : M N — > IR are continuous, a s £ At, the set of A- valued Jt-progressively measurable controls such 
that 

E tx (J \a s \ 2 ds) < +oo (40) 

and Xl' x is the solution of The value function is defined by 

V(x,t) = inf J(t,x,a s ). (41) 

a s GAt 

At least formally, the Dynamic Programming Equation associated to this control problem is 

duo 1 
- — + sup{-(6(a;, t, a),Dw) - £(x, t, a) - -Tr (a(x, t, a)a(x, t, a) T D 2 w)} = (42) 
at aeA 2 

in M N x (0, T), with the terminal value condition w(x,T) = ip(x). 

Our main goal is to characterize the value function V as the unique continuous viscosity solution of 
(|42|) with the terminal value condition V(x, T) = i/j(x). We recall that the fact that the value function is a 
viscosity solution of the equation (J42J) is in general obtained by a direct use of the Dynamic Programming 
Principle. Since we are in an unbounded control framework, the proof of the Dynamic Programming 
Principle is rather delicate, thus we follow another strategy which consists in comparing directly V with 
the unique viscosity solution U of (|4"2")l obtained by Corollary 12.11 when this latter exists. 

We make the following assumptions on the data. 

(50) A is a subset (possibly unbounded) of a separable complete normed space. 

(51) b £ C(M N x [0,T] x A; M N ) and there exists C > such that, for all x,y £ M N , t £ [0,T] and 
a £ A we have 

\b(x,t,a) -b{y,t,a)\ < C\x - y\, 

\b(x,t,a)\ < C(l + \x\ + \a\); 
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(S2) a e C(R N x [0,T] x A;M n ,m) and there exists C > such that, for all x,y G f G [0,T] and 
a A we have 

|<r(iE,t,a) - a-(j/,t,a)| < C|a;-j/|, 
|o-(ar,*, a)| < C(l + \x\). 

Moreover we assume that £ and ip satisfy respectively (Al)(iii) and (A3). 

We first observe that under the current assumptions (SI) and (S2) on b and a, for any control a G At 
satifying PU|) and any random variable Z such that E[Z] < oo, there exists a unique strong solution of 
the stochastic differential equation (f39l) which satisfies 

< oo 



E{ sup |A^| 2 } 

t<s<T > 



(see e.g. Appendix D in [19]). Moreover, we have better estimates on the trajectories of (|39|) . 

Lemma 3.1 Assume (SO), (SI) and (S2). For every (x,t) G M N x [0,T] and every a s G *4t, the 
solution X l s ' x of h39i) corresponding to a s , satisfies the following properties: 

(i) there exists a constant C > such that 

E t J sup \Xl- x \ 2 \<{\x\ 2 +C{T-t) + CV tx ( T \a s \ 2 ds)e c ^ ; (43) 

1 t<s<T > Jt 

(ii) there exists C x . a > which depends on x and on the control a s such that, for all s,s' G [i,? 1 ], 

E tx {\Xt< x ~ Xl?\} < C x , a \s - s'\^ 2 . (44) 
In particular for all r G [t, T] we have 

E tx { sup \X l s x -x\\< C x , a \ T \ 1/2 - (45) 



t<S<T 

<2 



Proof of Lemma \3.1[ We start by proving (i) . Let us take an increasing sequence of C 2 functions 
<Pr : M + -> IR+ such that for all R > 0, <p' R (r) = if r > 2R, ip R (r) < and (p R (r) t r, <p' R (r) t 1, as 
R — > +oo. By applying Ito's formula to the process tp R (\Xl' x \ 2 ), for a.e. t < r < T, we have (dropping 
the argument of ip R and its derivatives) 



m (\X^\ 2 ) = m (\x\ 2 ) + J 2<p R (X t s >*,b(X t s X ,s,a s )}ds 

+ |Vfl TV [^ T (^ ,a! . s .^)] + 2 ^k T ( X i' X ! s .^) X i' X | 2 ) ^+^Vfl(^' x ^(^' K ,s,a s )d^ s ).(46) 
By using the current assumptions on b and cr the following estimate holds 

£ (2</ K <X^6(X*>V,a s )> + ^Tr[^ ds 

< 2C ^ V ' R \X^\{\ + \X^\ + \a s \) ds + cj T ^(1 + \xr\ 2 ) ds a.s, 

where the constant C does not depend neither on the control a s nor on R. Moreover we observe that 
since ip' R = for t > 2R we have 



E, 



\ip' R (X^,a(X a ,s,a 3 ))\ 2 ds} < +c 
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hence the expectation of the stochastic integral is zero. By taking the expectation in and applying 
Fubini's Theorem we obtain 

E te {^(I^T)} < ¥>*(M 2 ) + C J* Ete V fl [2 + 5|A S ^| 2 + |a s | 2 ]} d s . 

Since </?/j, <p' R are increasing sequences , we can applying Beppo Levi's Theorem. Therefore by letting 
R — > oo we obtain, for every t < t < T, 

E te {|A^| 2 } < \x\ 2 + C J\ tx {2 + h\X^ x \ 2 + \a s \ 2 }ds 

5CJ T Etepr*'*! 2 ds + CE tx {J T \a s \ 2 ds} + 2C(T - t) 



< \x\ 2 



Applying Gronwall's Inequality we obtain 

E te {|X^| 2 } < (\x\ 2 + 2C(T - t) + CE tx {£ \a s \ 2 ds}) e 50 ^. 

We conclude by Doob's maximal inequality, (see, e.g |25]V 

The proof of (ii) is an extension of the one in the Appendix D in 19 u and we leave it to the reader. □ 

Proposition 3.1 Assume (SO), (SI), (S2), (Al) (Hi) for £ and (A3) for -0. Then there exists < r < T 
such that the value function V is finite and satisfies the quadratic growth condition \16}) in M N x [r, T] . 



Proof of Proposition \3.1\ We aim at showing that that if the constants p, C > are large enough then 
there exists r > depending on p such that \V(x, t)\ < C(l + \x\ 2 )e p{T -^ for all (x, t) € M N x [r, T]. The 
upper estimate is obtained by majorizing directly the value function with the cost functional corresponding 
to a constant control and using the estimates of the trajectories in Lemma 13.11 The most difficult 
is to prove the estimate from below since V is defined by an infimum. To this purpose we take any 
control a s £ At- By applying Ito's formula to the process (1 + \Xl' x \ 2 )eP^- s \ Xl> x being the trajectory 
corresponding to a g , we have the following estimate 

d[(l + |A*'*| V (T ~ s) ] = -pe p ( T - s \l + \Xl' x \ 2 )ds + e p(T - s) Tr (aa T (Xl' x , s, a s ))ds 

+2e" (T " s) (Xl' x , b(Xl> x , s, a s )ds + a(X^ x , s, a s )dW s ). (47) 

Integrating both sides of (|47[) from t to T and taking the expectation we get: 

E^l + lA^fl-a + MV^ (48) 



E, 



( - p(l + \Xl- x \ 2 ) + 2{X\' X , b(Xl< x ,s, a s )) + Tr(aa T (X s ,s, a s ))e^ T ~^ ds}. 



We notice that in the above estimate we supposed that the expectation of the stochastic integral is zero. 
This is false in general but we can overcome such a difficulty by an approximation argument which is 
similar to the one used in the proof of Lemma |3. II Now for any e-optimal control a s for V(x, t), by using 
we get 



V(x,t)+C(l + \x\ 2 y( T -V+e > E tx {j (£(X t s ' x ,s,a s )-2Ce'>( T - s \x t s x ,b(X t s < x ,s,a s )) 

-Ce piT - a) Tr((Ta T (X t s ' x ,3,a a )) + pe p{T - s) C{l + |A S | 2 )) ds 
+V>(A^) + C(1 + |A^T)} 



= E tx {l e(Xt' x ,s,a s )ds + i;(X^ x )}, 
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where £(x,t,a) := £(x,t,a) - 2Ce"( T -*) (b(x, t, a), x) - 2C*e"( T - t )Tr a(x, t, a) + Cpe^-^l + \x\ 2 ) and 
ip(x) :— ip(x) + C(l + \x\ 2 ). By analogous arguments as those used in Section [5] one can see that for 
p, C > large enough there is r > such that £ and -tp are nonnegative in M N x [r, T] . Thus we can 
conclude since e is arbitrary. □ 

Remark 3.1 If £,ijj are bounded from below, namely they satisfy, for some C > 0, the following two 
conditions £(x, t, a) > v\a\ 2 — C and ip(x) > — C, then V is finite and satisfies the growth condition (|T5|) 
in H N x [0,T] (i.e. for all time). 

Next we prove that V is the unique viscosity solution of (|4"2")l . We start with the following Proposition. 



Proposition 3.2 Under the assumptions of Provosition HOI we have 

(i) (Super- optimality principle) for all t £ (t, T] and < h < T — t and for all stopping time t < 9 < T, 
we have 

At+h)A6 

V(x,t)> inf VtA ^(Xf, S ,a s )d s + K(4; MAe ,(f+fe)Afl)}. (49) 

(ii) the function V is a supersolution of \4>ty * n x [t,T]. 

Proof of Proposition \3.2[ The proof of (i) is a standard routine and we refer the reader for instance 
to the book of Yong and Zhou [H] . The opposite inequality is more delicate, see Krylov [37J [55] . 

We turn to the proof of (ii), showing that the super-optimality principle implies that V* is a viscosity 
supersolution of gSJ). Let G C 2 (M N x [0,T]) and £ M N x (t,T) be a local minimum of V, - cj>. 

We can assume that V*{x,t) — 4>(x,t) and that the maximum is strict, i.e. V*(x,t) > 4>{x,i) for all 
(x,t) £ B(x,e) x [i — e,i + e) with (x,t) ^ (x,t) (see [3] or [6] ). We assume by contradiction that there 
exists S £ > such that for all (x, t) £ B(x, e) x [t — e, t + e], we have 

- <j) t {x,t) + sup{-(b(x,t,a),D<f)(x,t)) -£(x,t,a) - Tr ^-aa T {x, t, a)D 2 <j){x, t)}} < -5 E . (50) 

a£A 2 

Since (x, t) is a strict minimum of V* — 4>, it follows that there exists % such that 

V*(x,t) > <f>(x,t) +r) £ for all (x,t) £ dB(x,e) x [t-e,i+e]. (51) 

From now on, we fix < ft < e/2 such that hS £ < r\ s . Let us denote by Tt >x the exit time of the trajectory 
X\' x from the ball B(x, e). We first observe that by the continuity of the trajectory (see Lemma l3Tj) . wc 
have T ttX > t for all (x,t) £ B(x,s) x [0,T). For every (x,t) £ B(x,e) x (t — e/2,i + e/2), there exists a 
control a s £ At such that 



V(x,t)+ S -^>E U 



(t+h)AT t)l 



£(Xt>*, s,a.) ds + V.{Xfe h) ^ m ,{t + h)A r t . x )} 
Since V* > <j> in B(x, e) x [i — s,t + e], if Tt, x < t + h, then, from (|5"T) , we have 

Therefore the following estimate holds 
S F h 



V(x,t) + ^- > E tx { 



£(X t s ' x ,s,a s )ds + <j>(X t T ^,T tiX )+ V£ 

t+h 



L {T t , a <t+h} 



} 



+E tx { [ J £(X^,s,a a )ds + 4>(Xg h ,t + h)] l {rti .> t+fc} } 
> E te {[J(r tlB ) + Tie]l{T t ,.<t+h}} + Ete{-f(* + ^)l{T,,.>t+fc}}, 



(52) 
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where for all r' > 



J(r') = ^ HX**, s, a,) ds + <t>(X^y). 
Applying Ito's formula to the process <f>{X ' x , r'), we obtain 

I(r') = | T (^(X s t '% S ,a s )+0 t (Xl^ S ) + (^(Xl'^ S ) ) 6(X^, S , as )> 

+ iTr[ C rcr T (X s t ' a; , s,a s )D 2 4>fj ds + </>(x , t) + J (D(j>(X^ x ,s),a(X t s ' x ,s,a s )dW s ) a.s. 

Note that the expectation of the above stochastic integral is zero for r' £ [t, t + e]. 
Now we can estimate the two last terms in (l52j) . For the first term, we have 



> -E 



^txUl(n,x) + ?7e]l {r t , m <t+h}} 

{ \ r * ( ~ *> s ) + SUP{"^ «, «) " (D<P(Xt> x , s), b(Xl< x 7 s, a)) 

a {r«,«<t+/>}}- 



-^Tr [aa T (X l s x , s, a)D 2 ■</>]}") ds - cf>(x, t) - v , 
Since Xl ,x £ B(x,e) when s < Tt, x and since t + h < t + e, from (f50l) . we get 

®tx{[I(Tt,x) + J ?e]l{r t , a! <t+A}} > -E tx { / (-£ e ) ds - 0(z, t) - ?7 e l {r( x<t+/l} | 

> S s E tx [{T t , x - t)l ] +(Vs+<t>(x > t))P({T ttX <t + h}) 

> {r) s +cj)( X ,t))P({Tt,x<t + h}). (53) 

For the second term, we proceed in the same way, noting that, if Tt, x >t + h, then for all t < s < t + h, 
X l / X £ B(x,e) and it allows us to apply (f50|) . More precisely we have 



Eta; 
> — Ej tx 



{l(t + h)l {Tt>x > t+h} } (54) 
f [ / + (-MXt' x ,s) + sup{-l(Xi' x ,s,a)-{D<f>(Xt< x ,s),b(Xt< x ,s,a)} 



1 



Tr [era 1 (X*'*, s, a)L> 2 0]} ds - </>(x, i) 



1 



{n.x>t+h} 



} 



> {S e h + ^(x,t))P({T t:X >t + h}). 

Combining (|52j). ((53)) and (|53|). we get 



+ > VeP({n,x<t + h}) + 5 e hP({T t>x >t + h}) 

+</>(x, t) [P{{T t , x <t + h}) + P{{T Ux > t + h})] . 

Since r\ E > 8 e h and P({T t , x < t + h}) + P{{t^ x > t + h}) = 1, we get 

S h 

V(x,t)>cf>(x,t) + ^-. 

The above inequality is valid for all (x, t) £ B(x,e) x (t — e/2,t + e/2), thus we have 

S h 

liminf V{x, t) = VJx, t) > <f>(x, t) + -|- 

(x,t)-)-(x,t) 2 

which is a contradiction with the choice of d>. □ 



UNIQUENESS RESULTS FOR BELLMAN-ISAACS EQUATIONS 



20 



Theorem 3.1 Under the assumptions of Provosition HOI the function V is the unique continuous vis- 
cosity solution of \4%l i n -K x [t, T] . 

Proof of Theorem lff.it Let U be the unique solution of UU) in M N x [r,T] such that C/(x,T) = ip(x) 
given by Theorem 12.11 Our goal is to prove that V = U in M N x [r, T] . The inequality U < V* follows 
by combining Proposition 13.21 and Theorem 12.11 To show that V* < U in 1R N x [r, T], we proceed as 
follows: 

Step 1. We consider the functions V(x,t) := V(x,t) - C(l + \x\ 2 )e^ T ~ t '> and U(x,t) := U(x,t) - 
C(l + |a;| 2 )e p ( T_t ) . As it is proved in Step 2 of the proof of Theorem 12. 11 U is the unique solution of 

— Wt + sup {--Ty(o-o- t {x, t, a)D 2 w) - (b(x, t, a), Dw) - £(x, t, a)} = in M N x (r, T), 

a£A_ 2 (55) 

w(x,T) = i/)(x), 

where £(x,t,a) := £(x, t, a) + 2C^ T ~^ (b(x,t, a), x) + Ce^^Tr aa T (x, t, a) - Cpe^"*) (1 + \x\ 2 ) and 
i\)(x) :=^(x)-C{l + \x\ 2 ). 

Step 2. Claim: for all (x,t) € M N X [t,T], V satisfies 

V(x,t)< inf E te {/ I(X s ,s,a s )ds + iP(X t )}. (56) 



To prove the claim let us take any a s £ At- Arguing exactly as in the proof of Proposition 13. 11 from 
we have 



V(x,t) < E tx [J ( K e(X^ t ,s,a s ) + 2e^ T - s \X^,b(X^,t,a s )) 

+e p(T-s) Tr ( aa T( X x^ Sjas)) _ pe P(T-s) {1 + | X f*| 2 )) ds + il>(X^) - C(l + |X£*| 2 )} 

= E tx {J^ £(Xf- t ,s,a s )ds + i>(X*> t )}. 

Since a s is arbitrary we get (|56[) and prove the claim. 



Step 3. Choose C, p > large enough so that, for all (x, t, a) 6 J? x [r, T] x A, we have 

-Ce 2 "( T -*)(l + \x\ 2 ) + ^\a\ 2 < £(x,t,a) < -Ce^Hl + \x\ 2 ) + Ce"< r -'>(1 + |«| 2 ), 
-2C{l + \x\ 2 ) <4>{x) < 0, 

where C depends only on C and v. For all real R > and all integer n > 0, we set ^4„ := {a € 
A : \a\ < n}, £ R (x,t,a) :— m&x{£(x,t,a),—R} and ip R (x,t) :— max{-0(x, t), — R}. We observe that 
£ R : M N x [r, T] x A n — > M is bounded and uniformly continuous in a; € M N uniformly with respect to 
(t, a) £ [t, T] x A n and ^ : M N —> M is bounded and uniformly continuous in JR^. Set 

H (x, t 7 p, X) := sup{ — Tr(aa T (x, t, a)X) — (b(x, t 7 a),p) — £(x, t, a)}, 

aeA 2 

H 7 f(x,t,p,X) := sup {-^-Tr(o-o- T (x,t,a)X) - (b(x,t,a),p) -£ R (x,t, a)} 

aeA„ 2 

and define 

V*(x, t) = a inf_ n E tx J J t R {Xf\ s, a.) ds + 4> R {X^) \ , 
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where A™ is the set of A n -valued ^-progressively measurable controls such that (|4"0"]) holds. The function 
V R is now the value function of a stochastic control problem with bounded controls and uniformly 
continuous datas b, a, Ir and i/jr. These assumptions enter the framework of Yong and Zhou [41]. We 
deduce that V R is the unique continuous viscosity solution of 

- + H*(x, t, DV n R , D 2 V n R ) =0in#x (r, T), (57) 

with terminal condition V R (x,T) = tpR(x) in M . Moreover for all compact subsets K C M N there 
exists M > independent on R and n such that ||V^||oo < M in K x [r, T]. Indeed, take any constant 
control a s = a £ A±, by definition of V R for all R, n > and for every (x, i) € M N x [r, T] we have 

V R (x, t) < E tx {£ Ir{X x s '\ s, a) ds + i> R {X x /)} < £ C^ T ~^ (1 + a 2 ) ds < yP^(l + a 2 ), 

and on the other hand we have V R (x,t) > V(x,t) > -Ce 2p( - T ^(l + \x\ 2 ). 

Finally one can readily see that H R converges locally uniformly to H as n, R — > oo. Thus by applying 
the half-relaxed limits method (see Barles and Perthame [9]), the functions 

V(x,t) = limsup*!^ (at, i) = limsup V R (y,s) and V(x, t) = \imvai*V R {x, t) = liminf V R (y,s) 

(y,a)->-(a;,t) (y,s)->(x,t) 
n,fl->+oo n,R-*+oo 

are respectively viscosity sub and supersolution of ([55"j) . Theorem 12.11 yields V(x,t) < U(x,t) < V_(x,t). 
On the other hand by construction we have also V*(x,t) < limsup* V R (x, t). It follows V*(x, t) < U(x,t) 
and we can conclude. □ 



3.2 Some examples 

Example 3.1 A model case we have in mind is the so-called stochastic linear regulator problem which 
is a stochastic perturbation of the deterministic linear quadratic problem. In this case, the stochastic 
differential ([39]) is linear and reads 

dX** = [B(8)X* a >* + C(s)a s ]ds + ^[Q(s)Y^ + DjMdW* 

3 

and the expected total cost to minimized is 

J(x, t, a.) = E tx {£ l(Xl< x , Q(s)X^) + (a s ,R(s)a s )} ds + (X^, GX^)}. 

The previous results apply if the functions B(-),C(-),Cj(-),Dj(-),Q(-),R(-) and G are deterministic 
continuous matrix-valued functions of suitable size and if R(s) is a positive definite symmetric matrix. 
Deterministic and stochastic linear quadratic problems were extensively studied. For a survey we refer 
for instance to the books of Bensoussan [10] , Fleming and Rishel [18] , Fleming and Soner [19] , 0ksendal 
[55] . Yong and Zhou [H] and references therein. 

Example 3.2 Equations of the type (|42|) are largely considered in mathematical finance. See the intro- 
ductory books quoted in the introduction or Pham [39]. In particular recently Benth and Karlsen [11] 
studied the following semilinear elliptic partial equation: 



-w t --p 2 w xx +F(x,w x )=0 inKx(0,T), 



(58) 
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with the final condition w(x,T) = 0. The nonlinear function F is given by 

F{x,p) = -S p - {a{x) TT^P ~ ~1T\ 

I < J \ X ) o z {x) 

where 5, fi, p are real constant and a(x) and — (x) are C 1 functions satisfying 

a 

\a(x)\,\^(x)\ < Clasl, for all x e R. 
a 



Their main motivation is to determine via the solution of (|58[) the minimal entropy martingale measure 
in stochastic market. The conditions they assume on data fall within the assumptions of Section [2] 

Example 3.3 Another application of the results obtained in Section [5] is given by the finite time- horizon 
risk-sensitive limit problem for nonlinear systems. In the stochastic risk-sensitive problem, (I39[) reads 

dX^ = g(Xl' x ' s ,(3 s )dt+ J^c{Xl> x > e )dW s , (59) 

where Xl' x ' e g 1R N depends on the parameter e > 0, g represents the nominal dynamics with control 
/3 S G -B, a compact normed space and c is an N x fc-valucd diffusion coefficient, e is a measure of the 
risk-sensitivity and 7 is the disturbance attenuation level. The cost criterion is of the form 



J E (x,t,p 3 ) =Eexp. 



(60) 



and the value function is 

V £ {x,t) = inf : elog J e {x,t,fi s ) = elog ini ■ J e (x,t,0 a ), ( 61 ) 

where B% is the set of 5-valued, ^^progressively measurable controls such that there exists a strong 
solution to (|59|t. The dynamic programming equation associated to this problem is 

Quj [ ~ s 

-^-^(Dw,a(x)Dw)+G(x,Dw)-^Tr(a(x)D 2 w)=0 in M N x [r, T] , 

w(x,T) = ip(x), 
where a(x) — c(x)c(x) T and 

G(x,p) = max{{-g(x,f3),p) - f(x,0)}. 



We note that 



, 2 



1 (j 

(p,a(x)p) — min < — \a\ 2 — (c(x)a,p) \ . (63) 



In [IB] it is shown that as e J, (i.e. as the problem becomes infinitely risk averse), the value function 
of the risk-sensitive problem converges to that of a Hqo robust control problem. This problem can be 
considered as a differential game with the following cost functional: 



J(x,t,a,(3)= (f(y x (s),!3 s )-^\a s \ 2 )ds + ilj(y x (T)), (64) 
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where a s £ At ■— L 2 ([t,T], R k ) is the control of the maximizing player, (3 S 6 Bt := {measurable functions [i, T] — > 
B} is the control of the minimizing player, and y x (') is the unique solution of the following dynamical 
system: 

f = .g(y(s),/3 s )+c(y(s))a s , 
I i/(t) = x. 

Note that we switch notation from X t to y(t) to emphasize that the paths are now (deterministic) solutions 
of ordinary differential equations rather than (stochastic) solutions of stochastic differential equations. 
The dynamic programing equation associated to the robust control problem is a first order equation given 

by 

- ^ + min {^-H 2 - (c(x)a,Dw) \ + G(x,Dw) = in M N x (r,T) (65) 
at aeR k I 2 J 

with the terminal condition w(T,x) — ip(x). One of the key tools to get this convergence result is the 
uniqueness property for (p5|) . In Da Lio and McEneaney [TB], the authors characterized the value function 
of the ffoo control as the unique solution to ([6"5"jl in the set of locally Lipschitz continuous functions growing 
at most quadratically with respect to the state variable. Moreover the uniqueness result in [T6j is obtained 
by using representation formulas of locally Lipschitz solutions of (|65[) . We remark that the Comparison 
Theorem 12. II not only improves the uniqueness result for obtained in [TB] (in the sense it holds in a 
larger class of functions) but it also should allow us to prove the convergence result in [TB] under weaker 
assumptions, only the equi-boundedness estimates of the solutions of (|62p being enough by means of the 
half-relaxed limit method. 



4 Study of related equations 

In this Section we focus our attention to Hamilton- Jacobi equations of the form 

^- + {S(x,t)Dw,Dw) +G(x,t,Dw,D 2 w) =0 in M N X (0,T), 
ot (66) 

w(x,Q)=ip(x) inIR N , 
where T,(x,t) e Mn{1R) and G is given by (|3|) and 

^ + h(x)\Dw\ 2 = inM N x(0,T), 

w(x,Q)=ip(x) mM N , 

where h : 1R N — > M. Our aim is to investigate comparison (and existence) results for and (f6"T|) 
under assumptions which include Hamiltonians like (fT5|) in Remark I2.2f iii') (see Remark 14.11 for further 
comments). More precisely, we introduce two new assumptions: 

(A4) S € C(R N x [0,T];S+(J?)) and, for all x 6 1R N , t G [0,T], 

Q<E(x,t) and \E(x,t)\<C. 

(A5) h e (7(^5 JR), ft € W 2,oc (f ) where f is an open neighborhood of V := {x E M N : h(x) = 0} and, 
for all ier, 

Dh(x) = 0. 

Theorem 4.1 Assume (A2), (A3) and (A4) (respectively (A3) and (A5)). Let U € USC(R N x 
[0, T]) be a viscosity subsolution of i66]) (respectively J6'7| )j and V € LSC(R N x [0,T]) &e a viscosity 
supersolution of i f 6'6'p (respectively J6'7| )J satisfying the quadratic growth condition Mb)). Then U < V in 
R N x[0,T]. 
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The question of existence faces same problems as in Section O We have existence and uniqueness of 
a continuous viscosity solution for (|66[) and (|67[) in the class of functions with quadratic growth at least 
for short time (as in Corollary 12. ip . But solutions can blow up in finite time. 

Before giving the proof of the theorem, we give some comments on the equations and the assumptions. 

Remark 4.1 (i) In the same way as in Remark l2.21 above results hold replacing E by — E in ([55)1 and h 
by —h in (|67p and when dealing with terminal data in both equations. 

(ii) Coming back to Remark I2.2f iii) . we note (ai + a2)(et2 — ai) T is not necessarily symmetric in (|18[) 
whereas we assume E to be symmetric in (A4) (and h is real- valued therefore symmetric in (A5)). This 
is not a restriction of generality since comparison for (|66[) with E symmetric implies obviously comparison 
for dSU) for any matrix E, using that, for any E € Mn(M), (E + E T )/2 € S N (M). 

(iii) Coming back to Remark I2.2f iv) again, we see that (A4) corresponds to the case where the 
convex Hamiltonian is predominant with respect to the concave one in ([1]) with (|18|) . Assumption (A5) 
corresponds to (|18|) when a>\ and a% are real-valued but h is allowed to change its sign. For example, we 
have comparison for 

w t +(j){xf\Dw\ 2 = 0, 

where tj> € C 2 (M N ;M) is any bounded function. Let us compare (TT2|) with first-order Hamilton- Jacobi 
equations whose Hamilonians are Lipschitz continuous both in the state and gradient variables, or, to 
make simple, with the Eikonal equation 

^+a(x)\Dw\ =0 inM N x(0,T), 
ot 

where a is Lipschitz continuous function. We know (|13j. |30j ) we have existence and uniqueness of a 
continuous viscosity solution for any continuous initial data without any restriction on the growth. In 
this case, the sign of a does not play any role whereas it seems to be the case for the sign of h in (TT2"j) . We 
would like to know if comparison for (|12[) is true under weaker assumptions than (A5) and in dimension 
N > 1 (i.e. when E is neither positive nor negative definite in (|66l) ). 

(iv) There are some links between Theorem 12.11 and Theorem 14.11 Nevertheless we point out that, if 
Equation (flj under assumptions of Section [5] is naturally associated with a control problem, this is not 
necessarily the case under the assumptions of the current section. To be more precise, let us compare (fT]) 
with H given by (fT5j) and under (A4). The matrix a can be singular in (|T5|) whereas we impose the 
nondegeneracy condition E > in (|66l) . The counterpart is that the regularity assumption with respect to 
x on E is weaker (E is supposed to be merely continuous) than the locally lipschitz regularity we assume 
for a. Therefore (|66|) does not enter in the framework of Section [2] in general. A natural consequence is 
that proofs differ: in both proofs of Theorem 12.11 and 14 . 1[ the main argument is a kind of linearization 
procedure, but while in the proof of Theorem 12.11 we use essentially the convexity (or concavity) of the 
operator corresponding to the unbounded control set, here we use the locally Lipschitz continuity of the 
Hamiltonian with respect to the gradient uniformly in the state variable. 

(v) Note that we are able to deal with a second order term in (|66l) but not in (|67l) . 

Proof of Theorem \4-l\ We divide the proof in two parts, corresponding respectively to the case of 
equation (|66j) and (|67j). The main argument in both proofs is a kind of linearization procedure as the 
one of Lemma 12.21 The rest of the proof is close to the one of Theorem 12.11 

Part 1. We assume (A2), (A3) and (A4). 
The estimates of G are exactly the same than in Lemma T2.2I so. for sake of simplicity, we choose to take 
G = 0. The linearization procedure is the subject of the following lemma whose proof is postponed at 
the end of the section. 
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Lemma 4.1 Let < A < 1 and set ^f? = XU — V. Then ^f> is an USC viscosity subsolution of 

^.J^I^O ,,8-M.T), (6g) 
w(x,0) < (A- l)ip(x) inM N . 

If ip > 0, then it follows *(x,0) < in M N and using the above lemma with the same supersolution as 
in the proof of Theorem 12.11 we obtain >f < in M N x [0, T}. Note that the boundedness of £ (see (A4)) 
is crucial to build the supersolution. In the particular case when G = 0, we can also choose a simpler 
supersolution such as for instance 

\(\x\ - R)+\ 2 

(x,t)^K 1 -^ J-L+nt, K,L,R,r)>0 (69) 

J_ Lib 

Letting A go to 1, we conclude that U < V in M N x [0, T]. 

It remains to prove that we can assume ip > without loss of generality. To this end we use 
an argument similar to the one of Step 2 in the proof of Theorem 12.11 let U = U + M(l + |x| 2 )e p *, 
V = V + M(l + \x\ 2 )e pt , for some positive constants M and p and set ^? — XU — V. We can easily prove 
that, for p > 16M 2 Ce, ^ is a subsolution of (f68|) (with a larger constant 4(7 instead of 2(7) in M N x (0, r] 
for r = 1/p. Moreover *(x,0) < (A - l)(-0(^) + M(l + |x| 2 )e pt ) < for M sufficiently large (since ip 
has quadratic growth). Letting A go to 1, it follows that U < V in M N x [0, r] and we conclude by a 
step-by-step argument. 

Part 2. We assume (A3) and (A5). 
Set Q+_= {x G JR^ : /i(x) > 0} and n~ = {x e R N : h(x) < 0} which are open subsets of M N . Define 
* = At/-Vfor0<A<l, U=U + M(l + |a;| 2 )e p * and 1/ = V" + M(l + |a;| 2 )e pt with M larger than the 
constants which appear in (A3) and in the growth condition (|16[) . Arguing as in Lemma |4. II and noticing 
that all arguments are local, we obtain that ^ is a subsolution in tt + of the same kind of equation as 
namely 

dw C 

^-I-A-l^ in0+ xM> m 
w(x,0)<0 in n+, 

for some constant C = 16 ||/i||oo, P > 4MCe and r = 1/p > which are independent of A. Note that 
*(•, 0) < in JR N because of the choice of M. 

The sign of $ on T is the subject of the following lemma the proof of which uses (A5) and is postponed. 



Lemma 4.2 For all x G T, t G [0,T], we ftawe < %j)(x) < V(x,t). 

Noticing that {T, is a partition of M N , we set 

~ f sup{f,o} in (run+) x [0,T], 

\ inrrx[0,T] 

From the lemma, $ < in T x [0, T]. Therefore the function ^ is continuous in M N x (0,T). Moreover 
we claim that if? is a subsolution of (|7CT|) in iR^ x (0,r). This claim is clearly true in x (0,T) (since 
is clearly a subsolution) and in f2 + x (0, r) (since \1/ is the supremum of two subsolutions). It remains 
to prove the result on T. Let ip G C 1 (IR N x (0, r)) such that \& — achieves a local maximum at a 
point (x,t) G T x (0, t). Let (x,i) be in a neighborhood of (S,t). If cc G T U then < *f?(x, t) and if 
x G then = #(a;,t). In any case, (0 - tp)(x,t) < (* - <f){x,t) < (4f — ip)(x,F). But *(x,l) < since 
(x,t) G r x (0,t). Therefore (x,t) is a local maximum of — <p which ends the proof of the claim. The 
initial condition ^f? < in M N x {0} is trivially satisfied. From the comparison principle proved in Part 
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1 (for example using (jBT)|) as a supersolution) , we obtain ^ < in M N x [0,r]. Since t does not depend 
on A, we can send A to 1. We obtain U < V in (T U 0+) x [0,r]. We conclude in (T U Q+) x [0,T] by a 
step-by-step procedure. 

Repeating the same kind of arguments replacing f2 + by f2~ and ^ by Z7 — M(l + |a;| 2 )e p * — /z(V — 
M(l + |x| 2 )e^), < fi < 1, we obtain that U - V < in (r U Q~) x [0,T] which ends the proof. □ 

Proof of Lemma \4J\ We proceed as in the proof of Lemma l2"T2l We can assume that G = since the 
computations with G are exactly the same than in Lemma 12.21 

Note first that XU is an USC subsolution of 

dtv 1 

— + - (E(z, t)Dw, Dw) < in M N x (0, T), 
w(a:,0) < \t/>(x) in M N . 

Let <p € C(1R N x [0,T]) and suppose that iff — f reaches a strict local maximum at (x,t) g JR^ x (0,T] 
in some compact subset K c -R^ x (0, T\. We have 

max {A^tJ-^t)-^^,*)-^^}-**^,*)-^,*). 

(x,t),(y,t)eif, 2 £^ eiO 

The above maximum is achieved at some point (x s ,y s ,t s ). Writing the viscosity inequalities and sub- 
tracting them, we obtain 

,x £ +y £ , 1 /_. ,x £ +y £ . „x £ — y £ \ 1 „ ,a; 6 +-v £ . x £ — y £ 

£(y e ,* e ) I -5 D< ^( 3 '^) + 2 ^2 — ) >-2 D( f( 3 '^) + 2 ^2 — / -°- 

In the sequel, we omit to write the dependence in t £ and the point ((x £ + y £ )/2,t £ ) in the derivatives of 
f. Set p £ = 2(x £ — y £ )/e 2 , p x = Dip/2 + p £ and p y — —Dip/2 +p £ . We have 

> ft + -(T,{x £ )p x ,p x ) - (Y,{y £ )py,p y ) 

> ft + Q - 1^ (E(x £ )p x ,p x ) + ((E(a; e ) - Efj/e))^,^) + (E(y £ )p x ,p x ) - (E(y £ )p y ,p y ) 

> ¥>< + Q - !^ (£(%e)Px,Px) - m K (\x £ - y £ \)\p x \ 2 + (T,(y £ )p x ,p x ) - (E(y £ )p y ,p y ) 

where jtlk is a modulus of continuity for E in the compact subset if. Since E(y e ) is a symmetric matrix, 
we have 

(£(y £ )p x ,p x ) - (E(y s )py,p y ) = (E(y e )(p x +p y ),p x -p y ) =2(£(y £ )p s ,Df) 

= -{E(y e )Df,Df) + 2{E(y e )p x ,Df}. 



For any a > 0, denoting by ^/T,(y £ ) the positive symmetric squareroot of the positive symmetric matrix 
E(y E ), we get 



1 



2(Z{y £ ) Px , Df) = 2(y/-£(y e )p x , ^(y £ )Df) < a(E(y £ )Df,Df) + -(Z(y £ )p x ,p x ) 

a 

< a(Yj(y £ )Df : Df) + -(T,(x e )p x) p x ) + -(m K (\x £ - y £ \)p x ,p x ). 
a a 



It follows 



> ft + 



- - 1 - - E(z £ ) - 1 + - m K {\x s - y £ \)Id 
A a J \ a 



Px,Px ) - (1 + a){E(y E )Df,Df). 
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2A 1 111 

Take a = — — > in order to have - — 1 = -(— — 1) > 0. We recall that £ > by (A4), hence 

(1 — A) A a 2 A 

for e small enough the above scalar product is nonnegative. Thus 

> ipt - (l + a)(H{3je,tc)D<p,D<p) =ipt- ^±^{Z(y E ,t E )D<p,D<p). 
Letting e go to 0, we get 

2 







> Vt (x,t) - t)D<p(x,t), Dip(x, t)) 



which proves the result. □ 

Proof of Lemma \4-3\ We make the proof for U, the second inequality being similar. Let xq € T and 
consider, for r\ > 0, 

sup {U(x ,t)- r/t}. 
te[o,T] 

This supremum is achieved at a point to <E [0, T] and we can assume, up to subtract \t — t \ 2 that it is a 
strict local maximum. Consider, for e > 0, 

sup {U(x,t)~ l^-^l 2 - v t}. 

B(x o ,l)x[0,T] e 

This supremum is achieved at a point (x s ,t £ ) and it is easy to see that (x £ ,t £ ) — > (.to, to) when e — > 0. 

Suppose that t £ > 0. It allows us to write the viscosity inequality for the subsolution U at (x £ ,t £ ) and 
we get 



V + h{x £ ) 



r, x e — x 



2 



< 0. (72) 



Since h € W '°° in a neighborhood of F, we can write a Taylor expansion of h at xo for e small enough 

h(x £ ) = h(x ) + (Dh(x ),x £ - x ) + ^(D 2 h(x )(x £ - x ),x £ - x ) + o(\x e - x \ 2 )- 
From ((72]) and (A5), it follows 

r, - (2C + m(\x £ - x \ 2 )) ( ^ ~ X ^ ) ' < , 



where m is a modulus of continuity. Since \x £ — xq\ 2 je 1 — > as e — > 0, we obtain a contradiction for 
small e. 

Therefore t £ = for e small enough. It follows that, for all (x,t) £ B(xq, 1) x [0,T], we have 
U(x,t) - tz^l - v t< U(x £ ,0) - ^~ x °\ 2 < ^ Xe) , 
Setting x = Xq and sending e and then r\ to 0, we obtain the conclusion. □ 

References 

[1] O. Alvarez. A quasilinear elliptic equation in R^. Proc. Roy. Soc. Edinburgh Sect. A, 126(5):911-921, 1996. 

[2] O. Alvarez. Bounded-from-below viscosity solutions of Hamilton- Jacobi equations. Differential Integral 
Equations, 10(3):419-436, 1997. 



UNIQUENESS RESULTS FOR BELLMAN-ISAACS EQUATIONS 



28 



[3] M. Bardi and I. Capuzzo Dolcetta. Optimal control and viscosity solutions of Hamilton- J acobi- Bellman 
equations. Birkhauser Boston Inc., Boston, MA, 1997. 

[4] M. Bardi and F. Da Lio. On the Bellman equation for some unbounded control problems. NoDEA Nonlinear 
Differential Equations Appl, 4(4):491-510, 1997. 

[5] G. Barles. An approach of deterministic control problems with unbounded data. Ann. Inst. H. Poincare 
Anal. Non Lineaire, 7(4):235-258, 1990. 

[6] G. Barles. Solutions de viscosite des equations de Hamilton-Jacobi. Springer- Verlag, Paris, 1994. 

[7] G. Barles, S. Biton, M. Bourgoing, and O. Ley. Uniqueness results for quasilinear parabolic equations through 
viscosity solutions' methods. Calc. Var. Partial Differential Equations, 18(2):159-179, 2003. 

[8] G. Barles, J. Burdeau, M. Romano, and N. Samsoen. Critical stock price near expiration. Math. Finance, 
5(2):77-95, 1995. 

[9] G. Barles and B. Perthame. Exit time problems in optimal control and vanishing viscosity method. SIAM 
J. Control Optim., 26(5): 1133-1 148, 1988. 

[10] A. Bensoussan. Stochastic control by functional analysis methods, volume 11 of Studies in Mathematics and 
its Applications. North-Holland Publishing Co., Amsterdam, 1982. 

[11] F. E. Benth and K. H. Karlsen. A PDE representation of the density of the minimal entropy martingale 
measure in stochastic volatility markets. Preprint, 2003. 

[12] P. Cannarsa and G. Da Prato. Nonlinear optimal control with infinite horizon for distributed parameter 
systems and stationary Hamilton-Jacobi equations. SIAM J. Control Optim., 27(4):861-875, 1989. 

[13] M. G. Crandall and P.-L. Lions. Viscosity solutions of Hamilton-Jacobi equations. Trans. Amer. Math. Soc, 
277(l):l-42, 1983. 

[14] M. G. Crandall and P.-L. Lions. Quadratic growth of solutions of fully nonlinear second order equations in 
R n . Differential Integral Equations, 3(4):601-616, 1990. 

[15] M. G. Crandall, H. Ishii, and P.-L. Lions. User's guide to viscosity solutions of second order partial differential 
equations. Bull. Amer. Math. Soc. (N.S.), 27(l):l-67, 1992. 

[16] F. Da Lio and W. M. McEneaney. Finite time-horizon risk-sensitive control and the robust limit under a 
quadratic growth assumption. SIAM J. Control Optim., 40(5): 1628-1661 (electronic), 2002. 

[17] L. C. Evans. Partial differential equations, volume 19. American Mathematical Society, Providence, RI, 
1998. 

[18] W. H. Fleming and R. W. Rishel. Deterministic and stochastic optimal control. Springer- Verlag, Berlin, 
1975. Applications of Mathematics, No. 1. 

[19] W. H. Fleming and H. M. Soner. Controlled Markov processes and viscosity solutions. Springer- Verlag, New 
York, 1993. 

[20] Y. Giga, S. Goto, H. Ishii, and M.-H. Sato. Comparison principle and convexity preserving properties for 
singular degenerate parabolic equations on unbounded domains. Indiana Univ. Math. J., 40(2):443-470, 
1991. 

[21] H. Ishii. Perron's method for Hamilton-Jacobi equations. Duke Math. J., 55(2):369-384, 1987. 

[22] H. Ishii. Comparison results for Hamilton-Jacobi equations without growth condition on solutions from 
above. Appl. Anal, 67(3-4) :357-372, 1997. 

[23] K. Ito. Existence of solutions to Hamilton- Jacobi-Bellman equation under quadratic growth conditions. J. 
Differential Equations, 176:1-28, 2001. 

[24] F. John. Partial differential equations. Springer- Verlag, New York, fourth edition, 1991. 

[25] I. Karatzas and S. E. Shreve. Brownian motion and stochastic calculus, volume 113 of Graduate Texts in 
Mathematics. Springer- Verlag, New York, second edition, 1991. 

[26] M. Kobylanski. Backward stochastic differential equations and partial differential equations with quadratic 
growth. Ann. Probab., 28(2):558-602, 2000. 



UNIQUENESS RESULTS FOR BELLMAN-ISAACS EQUATIONS 



29 



[27] N. V. Krylov. Controlled diffusion processes, volume 14 of Applications of Mathematics. Springer- Verlag, 
New York, 1980. 

[28] N. V. Krylov. Stochastic linear controlled systems with quadratic cost revisited. In Stochastics in finite and 
infinite dimensions, Trends Math., pages 207-232. Birkhauser Boston, Boston, MA, 2001. 

[29] D. Lamberton and B. Lapeyre. Introduction au calcul stochastique applique a la finance. Ellipses Edition 
Marketing, Paris, second edition, 1997. 

[30] O. Ley. Lower-bound gradient estimates for first-order Hamilton- Jacobi equations and applications to the 
regularity of propagating fronts. Adv. Differential Equations, 6(5):547-576, 2001. 

[31] P.-L. Lions. Optimal control of diffusion processes and Hamilton- Jacobi-Bellman equations. I. The dynamic 
programming principle and applications. Comm. Partial Differential Equations, 8(10):1101-1174, 1983. 

[32] P.-L. Lions. Optimal control of diffusion processes and Hamilton- Jacobi-Bellman equations. II. Viscosity 
solutions and uniqueness. Comm. Partial Differential Equations, 8(11):1229-1276, 1983. 

[33] P.-L. Lions. Optimal control of diffusion processes and Hamilton- Jacobi-Bellman equations. III. Regularity of 
the optimal cost function. In Nonlinear partial differential equations and their applications. College de France 
seminar, Vol. V (Paris, 1981/1982), volume 93 of Res. Notes in Math., pages 95-205. Pitman, Boston, MA, 
1983. 

[34] W. M. McEneaney. Robust control and differential games on a finite time horizon. Math. Control Signals 
Systems, 8(2):138-166, 1995. 

[35] W. M. McEneaney. Uniqueness for viscosity solutions of nonstationary Hamilton- Jacobi-Bellman equations 
under some a priori conditions (with applications). SIAM J. Control Optim., 33(5):1560-1576, 1995. 

[36] W. M. McEneaney. A uniqueness result for the Isaacs equation corresponding to nonlinear control. 
Math. Control Signals Systems, ll(4):303-334, 1998. 

[37] H. Nagai. Bellman equations of risk-sensitive control. SIAM J. Control Optim., 34(1):74-101, 1996. 

[38] B. Oksendal. Stochastic differential equations. Universitext. Springer- Verlag, Berlin, fifth edition, 1998. An 
introduction with applications. 

[39] H. Pham. Smooth solutions to optimal investment models with stochastic volatilities and portfolio constraints. 
Appl. Math. Optim., 46(l):55-78, 2002. 

[40] F. Rampazzo and C. Sartori. Hamilton- Jacobi-Bellman equations with fast gradient-dependence. Indiana 
Univ. Math. J., 49(3): 1043-1077, 2000. 

[41] J. Yong and X. Y. Zhou. Stochastic controls, volume 43 of Applications of Mathematics. Springer- Verlag, 
New York, 1999. Hamiltonian systems and HJB equations. 



